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Abstract. In this paper, flow models of networks without congestion control 
are considered. Users generate data transfers according to some Poisson pro- 
cesses and transmit corresponding packet at a fixed rate equal to their access 
rate until the entire document is received at the destination; some erasure 
codes are used to make the transmission robust to packet losses. We study the 
stability of the stochastic process representing the number of active fiows in 
two particular cases: linear networks and upstream trees. For the case of linear 
networks, we notably use fluid limits and an interesting phenomenon of "time 
scale separation" occurs. Bounds on the stability region of linear networks are 
given. For the case of upstream trees, underlying monotonic properties are 
used. Finally, the asymptotic stability of those processes is analyzed when the 
access rate of the users decreases to 0. An appropriate scaling is introduced 
and used to prove that the stability region of those networks is asymptotically 
maximized. 

1. Introduction 

Most Internet traffic derives from tlie transfer of stored documents, correspond- 
ing to texts, music and movies. This traffic is elastic in the sense that the transmis- 
sion rate varies depending on current network congestion. Each document transfer 
is a flow of packets whose rate is usually regulated by the Transmission Control 
Protocol (TCP). The rate is allowed to increase linearly until a packet loss is ob- 
served. The rate is then divided by two. These two mechanisms ensure that network 
bandwidth is shared approximately fairly between the varying number of flows in 
progress at any time. TCP also ensures that lost packets are retransmitted. 

There is, however, no constraint on users to actually implement TCP algorithm 
and a more aggressive, greedy congestion control would be individually more prof- 
itable. Indeed, new, more aggressive versions of TCP are emerging to better exploit 
increasing link capacity [9l [131 [H] ■ Some have suggested that the packet retrans- 
mission function of TCP could be replaced by forward error correction in the form 
of source coding [20!. It consists in the use of erasure codes in order to encode 
flies before sending them into the network. As a consequence, if the flle has been 
divided in K packets, the destination is able to rebuild the data with (1 -I- e)K 
packets. A typical class of erasure codes which is adapted to source coding are the 
Digital fountains [18j . The use of source coding enables the relaxation of control 
requirements and facilitates aggressive packet transmission policies. 

If the congestion avoidance of TCP is no longer universally used, there is a danger 
that the Internet may again experience the congestion collapse observed in its early 
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days [19]. Packets dropped downstream and therefore retransmitted needlessly 
encumber upstream links, amplifying and spreading congestion. The consequence 
may be that the rate realized by concurrent flows is much less than the optimum 
(in terms of utility maximization) and may even tend to zero. The capacity of a 
network can be defined as the demand, flow arrival rate x mean flow size, that 
can be sustained. It depends on the way bandwidth is shared. It is important to 
understand what happens to capacity when the assumption that users compliantly 
implement TCP is relaxed. This is our objective in the present paper. 

In this paper, we assume users are greedy and do not implement congestion 
control. They send data at the greatest possible rate determined by an external 
constraint that we assimilate to an access rate. Bandwidth sharing is determined 
by this behavior. We consider a how-level model, as decribed in T^, where the 
bandwidth allocation changes instantly as new flows arrive or existing flows termi- 
nate. Tail dropping is interpreted in this model such that, at each link, the output 
rate of flows is proportional to their input rate to the link in question. This is 
consistent with the assumption that packets are all equally likely to be dropped. 
The drop rate is such that the overall output rate is bounded by the link capacity. 
Flows are categorized into classes defined by their route and their access rate. We 
assume flows arrive according to a Poisson process and have an exponentially dis- 
tributed size. The stochastic process describing the number of flows in each class is 
a Markov process. We say that the network is stable when this process is recurrent 
positive and unstable otherwise. 

To illustrate the realized bandwidth sharing without congestion control, consider 
the linear network depicted in Figure [2] with two links 1, 2 of capacity Ci and C2, 
respectively, uq class-0 flows going through links 1 and 2, ni class-1 flows going 
through link 1 and 712 class- 2 flows going through link 2. The access rate for class- fc 
flows is denoted by a^. The aggregate input rates of classes and 1 at the first link 
are respectively nooo and niOi and the total input rate at link 1 is i?i = ngao-f riioi. 
If Ri > Ci , then the first link is saturated and the aggregate output rates of classes 
and 1 are respectively 



Ci- 



noao 



noflo -I- nifli 



and 9 



Ci- 



nooo -I- nioi 



If Ri < Ci then the first link is not saturated and 9q — uqUo and 0l — niai. The 
aggregate input rate of class at link 2 is 9^ and the aggregate input rate of class 
2 is 7^202. As above, we derive the respective aggregate output rates of class and 
2 after link 2: 



min 1 , 



C2 



^202 



and ^2 — ^2(12 min 1 
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Figure 1. A cychc network 



Figure 2 . A linear network 
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The question of the capacity of networks without congestion control has aheady 
been addressed in [4]. It was shown that congestion collapse does occur in cyclic 
networks like that depicted in Figure [T] where the system is unstable for any positive 
demand. In acyclic networks, however, capacity is not reduced to and this perfor- 
mance degradation is significantly mitigated by the access rates. It was conjectured 
in [4] that capacity in acyclic networks increases as access rates tend to and, in 
the limit, is determined only by the optimal per-link stability conditions. In this 
paper, we prove that the conjecture is indeed true for two particular acyclic topolo- 
gies, linear networks and upstream trees. For linear networks, we derive bounds on 
stability conditions for arbitrary access rates. 

Averaging phenomenon. We evaluate stability conditions by applying fiuid limit 
techniques. The end-to-end class in a linear network plays a particular role. In the 
fluid limit, all other flow classes are shown to empty in finite time for any initial 
conditions. When all these classes are empty, a phenomenon of averaging occurs 
and allow us to prove that the end-to-end class also empties in finite time. In that 
situation, the rate at which this class evolves depends on the stochastic evolution 
of the remaining local classes which in turn depends on the current fiuid state 
of the end-to-end class. This dependence is decoupled by a time scale separation 
argument. The rate at which the fluid component (the end-to-end flow) evolves 
is infinitely slower than the rate at which the stochastic components evolve. It 
is therefore possible to apply a quasi- stationary model through which the average 
impact of the local traffic can be evaluated. 

This is a non-trivial example of a local equilibrium of fluid limits. A simpler 
example of such a phenomenon can be found in [21] 9.6, p271]. Averaging in 
fiuid limits has also been considered in the context of wireless networks (see [2] 
and subsequent papers |24] and [10]). The main difference here is that the local 
equilibrium depends on the state of the fluid limit. Note that this is somewhat 
related to the averaging phenomenon considered for loss networks [12 . 

To evaluate the impact of access rates on capacity, we introduce an ad-hoc scal- 
ing. Scaled processes are shown to converge to a simple deterministic process. 
Generally speaking, the convergence of processes does not imply the convergence 
of stationary distributions. However, in our case, we can prove this is true in two 
specific cases exhibiting an interesting example of limit inversion for stochastic pro- 
cesses. We use the same technique as in [7] to prove this inversion. We use the 
convergence of stationary distributions combined with the averaging phenomenon 
to prove the asymptotic optimality of linear networks. For upstream trees, we use 
convergence and monotonicity. 

The paper is structured as follows. In Section [21 we give a complete descrip- 
tion of the considered model. In Section [3l we study the stability conditions of 
linear networks with general access rates. In Section |4l we study the stability of 
linear networks and upstream trees when access rates decrease to and prove their 
capacity is asymptotically optimal. 

2. Flow-level model 

2.1. Bandwidth allocation. Consider a network of L links. Denote by C; the 
capacity of link I. A number of fiows compete to share the capacity of these links. 
The fiows are categorized into a set of K classes. Each class- fc flow has an access rate 
to the network denoted by au and follows a route of length dk defined as an ordered 
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set of distinct links rt — {rk{l),rk{2), . . . ,rk{dk)}- Let x = {xi, . . . ,xk) be the 
vector of input rates of all classes, ipkix) the aggregate throughput of class- fc flows. 
We refer to the vector '4}{x) = (-01 (x), . . . ,-0^(2^)) as the bandwidth allocation. 

Here, we consider allocations that result when users are greedy and transmit at 
their maximum input rate in the network without any congestion control. There 
can be losses on each link of the network and we need to describe the evolution of 
the rate of each flow going through the network. Specifically, we assume that class- 
k fiows initially transmit at full rate 0^{x) — Xk — nkdk where Uk is the number 
of class- /c active fiows and we denote by the class-fc rate at the output of the 

i-th link on its route rj,, for i — 1, 2, . . . , d^. The actual throughput ipkix) of class 
k corresponds to the aggregate throughput of class- fc fiows at the output of the last 
link on their route, ipkix) = 9'^^{x). Due to potential loss at each link, we have 

(1) 0fc(x) = e'l'-ix) < ei^'^x) <...< el{x) < el{x) = Xk = UkUk. 

In particular, Olr^{x) — OKx) is the loss for class k occurring at the i-th link on its 
route. 

The total rate at the output of each link cannot exceed the capacity of this link, 
so that 

(2) V;, ^U2^)<C/. 

k,i:rk(i)=l 

In order to characterize the allocation achieved in the absence of congestion 
control, it remains to determine how output rates depend on input rates at each 
link. This depends on the buffer management policy. In the considered fluid model, 
losses occur on saturated links only when the total input rate exceeds the capacity; 
the total output rate is then assumed to be equal to the capacity. In the following, 
we consider a single buffer management policy. Tail Dropping, which simply consists 
in dropping each incoming packet when the buffer is full. We deduce that, at the 
flow level, the output rate of classes from the link is proportional to the input rate 
of classes to the link. 

Specifically, let Ri{x) be the total input rate of link I: 

Ri{x) = ^fc(^)- 

k,i:rk(i+l)=l 

If Ri{x) < Ci then link I is not saturated and there are no losses; the output rate 
is equal to the input rate for each class. If Ri{x) > Ci, then the link is saturated 
and there are losses proportional to the input rate. The output rate of any class k 
then satisfies for all i = 1, 2, 3, . . . , dfc, 

(3) 6l{x)=9lr'{x)min(^j^^,?l where Z = r^^. 

When there is no ambiguity and when the access rates are fixed, the bandwidth 
allocation is determined by the number of flows in each class. We denote by n = 
(ni, . . . , npc) the vector of the numbers of flows in progress and by the vector (j){n) = 
(01 (n), . . . , 0x(?i)) the bandwidth allocation where, for each k, 0fc(n) = ipkio, n) 
where denote the componentwise product. 

For example, we can consider a linear network under tail dropping (see Section 
|3l) with two links of capacity 1 with access rates all equal to 1 and 1 flow in each 
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class. We get the following bandwidth allocation: 

0O(1,1,1) = ^, <^l(l,l,l) = i 02(1,1,1) = ! 

It is not obvious that ([3]) defines a unique allocation for all networks. The defini- 
tion is clearly non-ambiguous for acyclic networks, i.e., if links can be numbered in 
such a way that each route consists of an increasing sequence of link indexes. The 
allocation then directly follows from applying ^ to all I = 1, . . . , L, successively. 
For general networks, the allocation is still well-defined and unique as proved in [3]. 
In this paper, we consider only acyclic networks. 

2.2. Flow dynamics. We assume that class-/c flows are generated according to 
a Poisson process of intensity Afe and have independent, exponentially distributed 
sizes with mean 1/^fc. We define the traffic intensity of class- A; fiows as pk — Xk/lJ-k- 
Under the above assumptions, let N{t) denote the number of fiows at time t, 
{N{t),t g M+) defines a Markov process with transition rates Afe from state n to 
state n + Ck and 4'k(ri)fj,k from state n to state n — Ck, where denotes the vector 
with 1 in the k-th component and elsewhere. We say that the network is stable 
when this Markov process is ergodic. There is a well-known necessary stability 
condition (see [3]) which is that the traffic intensity is less than the capacity for all 
links: 

(4) v;, < 

k-.lerk 

An allocation will be called optimal if this condition is also sufficient. In the rest 
of this paper, this condition will be further referred to as the optimal stability 
condition. 

In the following, we study stability conditions for two specific classes of networks. 
In Section [3l we consider linear networks. In Section |4l we study the behavior of 
stability conditions when the access rates are small for linear networks and upstream 
trees. 

3. Stability conditions for a linear network 

3.1. Linear networks. We consider a linear network with L links as depicted in 
Figure [2] For the sake of simplicity, we assume that the capacity of all links is 1 
but all the results are true in the general case and can be obtained by adapting 
the notation. The linear network has K = L + 1 different classes of fiows. Class-0 
fiows go through all links. We label the links of the network from 1 to L. Link I 
is the l-th link on the route of class-0 fiows. Class-/ fiows go through link / only. 
Equation (|3]) can be rewritten as follows for a given state n and for 1 < k < L: 

To simplify the presentation, we suppose that oq = 1 and ai = 1. In that case, 
a single fiow of class or 1 is enough to saturate the first link and we have 

el{nQa)= and 9l{nQa)^ . 

" ' ni+no ' no + m 
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All the results presented here remain true without this assumption. Only the proof 
of Proposition [6] has to be adapted. 

In the rest of this section, we study the stability conditions of the stochastic 
process resulting from this linear network. The optimal stability conditions (|4]) are: 

(5) po + Pfc < 1 for l<k<L. 

3.2. General fluid limits. We show that classes 2,. . . ,L are favored compared 
to classes and 1 in the sense that the ergodicity conditions of classes 2, . . . , i do 
not depend on classes and 1 but the contrary is not true. 

In order to study the ergodicity of the system, we need to define fiuid limits. 
In the following, we consider the norm such that for x £ M.^ , \\x\\ — l^^l- 
Let (m',i € N) be a sequence of such that limi^oo II't^-NI = Define for all 
m G , the process {N"^{t)) describing the system evolution under tail dropping 
when starting at iV™(0) — m. A fluid limit Z of the system is defined as an 
accumulation point of the laws of the processes in the set 

C = {iN"'\\\m'\\t)/\\m'\\,t> 0)Ae n} 

which is regarded as a subset of the space ZJrn ([0, oo)) with Skorohod topology 
(see [T]). It can be proved, as in [31] Prop 9.3 p 246], that the set C is relatively 
compact and that all the fluid limits Z are continuous. 

In order to prove ergodicity of the process {N{t)), we just have to prove that 
there exists a time T such that for any initial condition of {Z{t)), for all t > T, 
Z(t) = (see [6]). On the contrary, in order to prove transience, we have to prove 
that there exists a time T such that after T, any fiuid limit {Z{t)) increases linearly 
(see [U]). For that purpose, we have to characterize the fluid limits. 

First, we consider fluid limits such that there exists 2 < ko < L with Zkg{^) > 0. 
At the stochastic level, for each k > 2, class k can use an arbitrarily large part of 
link k leaving almost nothing to class 0; for any e > 0, since 0Q~^{n a) < 1, if Uk 
is large enough, we have 

0fc(") > 1 - £, and dQ{n a) < e. 

Thus, at fluid level, the throughput for {Zk{t)) is always 1 if Zk{t) > 0. On the 
contrary, the throughput for {Zo{t)) is as long as there exists ko with Zkg{t) > 0. 
We can prove, as in Prop 9.4, p247], the following proposition. 

Proposition 1. // {Z{t)) is a fluid limit of the system and there exists some time 
interval [0, to] such that for any t S [0, to], there is some fco *^ {2, . . . , L} such that 
Zk„{t) > then, almost surely, {Z{t)) is differentiate on [0,to] o,nd satisfies for all 

t e [0,to], 

(6) Zo{t) = Ao, 

(8) Zk{t) - (Afc - Mfc)l{z,(t)>o} for 2<k<L. 

For 2 < k < L, Zk{t) thus decreases linearly to ii pk < 1- Note also that 
{Zk{t)) for 2 < fc < i docs not depend on classes and 1. This illustrates the 
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strong asymmetry between classes and 1 on one hand and classes 2, . . . , L on the 
other hand. 

If there exists 2 < ko < L such that pk^ > 1 then it is clear that the fluid 
limit will increase linearly to infinity and the process {N{t)) is transient. On the 
contrary, if p^o < 1 for all 2 < fc < L then there exists a time T such that for t < T 
and 2 < k < L, Zk{t) = 0. In order to study ergodicity and transience of {N{t)) we 
then have to characterize the fluid limits such that Zk{Q) = for 2 < A; < i. This 
is the purpose of the next subsection. 

3.3. Quasi-stationary fluid limits. Before studying fluid limits, we need to de- 
fine the average throughput of class in the quasi-stationary case. This corresponds 
to the case where the number of flows in classes and 1 is fixed and the number of 
flows in classes 2, . . . , i varies. In the following, we denote by X2:l = {x2, ■ ■ ■ ,xl) 
the input rates of classes 2, . . . ,L. Fixing the number of flows in classes and 1 is 
equivalent to considering a fixed rate a for class after link 1. Since link 1 is of 
capacity 1, a £ [0, 1]. Define 9l{a, x^-.l) = oi and, for 2 < < L, 



The quantity 6*0 (cc, xi;l) is the output rate of class after link k and the throughput 
of class is 'ipo{ct,X2:L) = ^o(^'^2:l). Moreover, il)k{oi,X2:L) is the throughput of 
class k. For Q <k < L and for n2;L G N^~^, we define </)fe(Q!, n2:L) = i/Jkia, n2:L&a)- 
Denote by {N^.^it)) the Markov process describing the evolution of classes 
2, . . . , L in the quasi-stationary case. It is defined on and its transition 

rates are, for 2 < fc < L, 



Proposition 2. Consider a linear network with L links of capacity 1 in the quasi- 
stationary case, i.e., when the number of flows in classes and 1 is fixed and the 
rate of class after link 1 is a. 

The Markov process (N^.i^it)) describing the evolution of classes 2, . . . ,L is er- 
godic if for 2 < k < L, pk < 1. It is transient if there exists ko in {2, . . ., L} such 
that pko > 1. 

Proof. It is enough to see that for 2 < fc < L, 



Since Ck = 1, li pk < 1 for all k, there exists e > and 77 in N such that for all 
n2:L in \ {0, . . . , rj}'^~^ and for 2 < fc < i such that > rj, 



(10) 




Uk Uk + 1 : Afe, 

Uk ^ Uk-l : Pk4>k{0l,n2:L)- 



mm {nkak,Ck) > 4'k{a,n2:L) > 



HkUk 



Cfe-i + nkttk 



Afe - Pk^k{0i,n2:L) < -£ 



and (A^2:l(*)) is therefore ergodic. 
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Conversely, if there exists ko such that pkg > 1, then there exists £ > and rj 
such that for all n^.L with Ukg > rj, 

and (-/V^^(t)) is therefore transient. □ 
When {N2.i^{t)) is ergodic, denote its unique stationary distribution by tt". The 
average throughput of class in the quasi-stationary case is then defined as follows: 

(11) Va e [0,1] 0o(a) -E#4^o(a,.)) = *"(«2:L)0o(a, n2:L). 

The average ipo depends on the traffic intensities and access rates of classes 
2,. . . ,L. In order to establish ergodicity and transience conditions for the linear 
network in Theorems [1] and [5] below, we need the continuity of the function (pQ with 
respect to a. 

Subsequent developments rely on the following notion of stochastic domination. 

Definition 1. Let X and Y be two random variables in a partially ordered measur- 
able space. We denote X <st Y and say that Y stochastically dominates X if, for 
any positive non- decreasing measurable function f, we have M[f{X)] < K[f(Y)]. 

On R", we use the usual coordinate-wise partial orders. If x and y are in M", 
X < y if Xk l£ yk for all k. On the space _D(R_|_, M"), we say that x < y if 
^k(t) < ykit) for all k and t. 

For any two random variables X and Y with respective distributions ttx and ny 
and such that X <st Y , we say that ny dominates ttx ■ 

In particular, if {X{t)) and (Y{t)) are two Markov processes on N" such that 
{^{t)) <st {Y{t)) and {X{t)) is irreducible, the ergodicity of {Y{t)) implies the 
ergodicity of {X{t)) and the transience of {X{t)) implies the transience of (Y{t)). 
If {Y{t)) and {X(t)) are ergodic and X{(x) and Y{oo) are random variables with the 
stationary distributions of {X{t)) and {Y{t)) as distributions then X{oo) <st Y{oo). 
For more details on stochastic domination, see |15) . 

Lemma 1. Consider a linear network with L links of capacity 1 in the quasi- 
stationary case and assume that pk < 1 for 2 < k < L, the function (j)Q defined by 
Equation (jlip is continuous with respect to a on [0,1]. 

Proof. First, we prove that a i-> (t>kict,n2:L) is 1-Lipschitz for all n2:L and k. 
By definition, a 9Q{a,n2:L) is 1-Lipschitz. According to © and (flUl) . a H> 
0Q{ct,n2;L) and a f-^ </'2(q^j '^2:l) are defined as the minimum of two 1-Lipschitz 
functions and are then 1-Lipschitz functions. The result follows by recursion. 

In particular, this is true for a ^ 0o(q^, "■2:l). In order to prove the continuity 
of 00, we just have to prove that if a sequence (a^) of [0, 1] converges to ttoo, then 
iV^^(oo) converges in distribution to iV^|^(oo) and these random variables have 
tt"' and 7r"°° as respective distributions. 

We first prove that {7r",Q! G [0, 1]} is tight. Note that for 2 < fc < L and a in 
[0,1], 



(12) 
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Define the process {N2:L{t)) with the following transition rates for 2 < k < L: 

rife H- nfe + 1 : Afc, 



1 + Ukak 



and such that N2:l[^) — N^.i^iO). The components of (A^2:L(i)) are independent. 
For 2 < k < L, we have pk < 1 and there exist e > and 77 such that, for > 77, 
we have 

M — Mfe— < — £, 

1 + Ukak 

which implies that {Nk{t)) is ergodic; the ergodicity of (A'2:l(^)) follows. Using 
Equation (|12l) and a standard coupling argument, see for instance [5, Lemma 1], 
we can prove that, for a in [0, 1] and 2 < k < L, {Nk{t)) stochastically dominates 
{N^{t)). It implies that {N2:L{t)) stochastically dominates (./V^^(t)) for any a e 
[0,1]. This implies that the stationary distribution tt of (A'^2:L(i)) dominates any 
distribution tt". In particular, we have 

Vae [0,l],VKeR, w"{N'^-^\[0,k]^-^) <tt{N^-^\[0,k]^-^). 

Thus, the set {7r",a S [0, 1]} is tight on N^~^ with the usual topology. 

By tightness, we can suppose that the sequence (7r"')igN is convergent. We call 
TToo its limit. All we have to do now is to characterize this limit and prove its 
uniqueness. 

Let / be a bounded function on N^^^. For any a in [0, 1], let Cl" denote the 
infinitesimal generator of (A^^i(i)). For all n2:L £ N^~^, 

L 

f^"(/)(n2:L) Afc(/(n2:L + Ck) - /(n2:L)) 

k=2 

L 



A*fe0fe(Q:, n2:L)if{n2:L - efc) - f{n2:L))- 



fe=2 

Since a 1— t- (/>fc(Q!, fi2:L) is 1-Lipschitz for all n2:L and k and / is bounded, there 
exists 77 such that 

(13) e N, V?.2:L e N^"2^ |f^"°°(/)(n2:L) - f^"'(/)(ri2:L)| < ry|aoo - 
Because (tt"') is tight, for any e, there exists k > such that 

(14) \/i eN, n°"{[0,K]^~^) >l-e. 
Using equations ([T3|) ) and (fT4l) . we have 

lim / fi"'(/)(n2:L)^"'(d?.2:L) = / (/) (n2:L )^oo (rfn2:L ) = 0. 

We deduce that fc^ is an invariant distribution of {N^.J^ (t)) and by uniqueness, we 
have TToo = . Finally, we have 

lim 00 (aj) = 0o(aoo)- 

□ 

We are now able to characterize the fluid limits {Z{t)) such that Zfe(O) = for 
2 < k < L. The next proposition is proved in the appendix. 
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Proposition 3. Consider a linear network of L links of capacity 1 and assume 
that ao = 1 and ai = 1. 

If {Z{t)) is a fluid limit of the system such that Zk{0) = for 2 < k < L, then 
almost surely 

(15) ^°")-^°-"°^°( z.(,)°h!1w )- 
(17) Zk{t)^0 for2<k<L 

hold for all t £ R_(_ where 4>q is the average throughput of class in the quasi- 
stationary case defined by Equation (jlll) . 

This proposition stiows tliat, at tlie fluid time scale, tliere is a separation of time 
scales between classes and 1 and 2,. . . ,L. From the point of view of classes 
and 1, classes 2, . . . , L are quasi-stationary and there is an averaging because they 
evolve infinitely faster. From the point of view of classes 2,...,L, the ratio of 
classes and 1 is constant. This is a further illustration of the asymmetry between 
classes 0, 1 on the one hand and classes 2, . . . , L on the other hand. 



3.4. Stability of a linear network. Now that we have characterized the fluid 
limits of the system, we can study the stability conditions of the linear network. 
Theorem [T] gives a sufficient condition for stability and Theorem [5] gives a sufficient 
condition for transience of {N{t)). 

Theorem 1. Consider a linear network of L links of capacity 1. 
If Pk < ^ for 2 < k < L and 

po < inf (f>Q{x) 

l—pi<x<l 

then the network is stable, i.e., {N{t)) is ergodic. 

Proof. In order to prove ergodicity, we just have to prove that there exists a time 
T such that for any initial condition of (Z(i)), for all t >T, Z{t) = (see [6 ). 

We consider a general fluid limit {Z{t)). As proved in Proposition [1] as long as 
there exists fco such that Zko{t) > 0, {Z{t)) satisfied Equations ©, (0) and 
Since pfe < 1 for 2 < k < L, there exists a finite time Tq such that, for all fc > and 
t > To, Zk{t) = 0. According to the strong Markov property, the study is reduced 
to the case where the initial state of the fluid limit verifies Zo{0) + Zi{0) ~ 1 and 
Zfc(O) = for 2 < fc < L. According to Proposition El {Z{t)) satisfles (HH) 
and ([TTI) . In particular, for alH > and 2 < fc < i, we have Zk{t) — 0, we then 
just have to study the behavior of (2'o(i), Zi{t)). 

We define the following function: 

Va 6 [0,1], /(a) = inf^ M^) 
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This function is continuous, non-decreasing and satisfies f{a) < (f>o{a) for all a G 
[0, 1]. We define {F{t)) such that Fo{0) = Zo(0), Fi{0) = Zi(0) and for all t > 0, 

(18) Fo(i) = Ao-Mo/' 



(19) Fi(t) = Ai-Aii 



Foit)+Fiit) 
Fi{t) 



Foit)+Fi{t)- 



Since we have 0o(ck) > /(a)j we can deduce for all t > 0, Zo(t) < Fo{t) and 
^i(^) < This follows from the following. 

• If Zo(t) = -Fo(i) and Zi(t) = Fi{t) then Zo(t) < i^o(0 and Zi{t) < Fi{t); 

• if Zn{t) < Fo(<) and Zi{t) = Fi{t) then Zi(t) < Fi{t); 

• if Zo(t) = Foit) and Zi(<) < Fi{t) then Zo(i) < ^o(i)- 

To prove the stability of {Z{t)), it is enough to prove that {F{t)) will return to 
in finite time. Let a{t) = Fo{t)/{Fo{t) + Fi{t)). We have 

(20) a{t) - p^(^^^Ip^^^^ [(Ao - Mo/(«(t))) (1 - «(t)) - (Ai - Mi(l - a(t))) a{t)] . 
Let I3{t) = (Ao - ^lofiait))) (1 - a(^)) - (Ai - /ii(l - a{t))) a{t). So that 

m 



(21) ait) 



Foit) + Flit)' 



We also define ao = max{a G [0, 1], /(a) = po}- Since po < /(I — pi), we have 
ao < 1 — pi. Further, for to such that a(t) = ao and ti such that a{ti) = 1 — pi, 

/3(to) = ao(pi(l - ao) - Ai) > 0, 
/3(ii)-Pi(Ao-po/(l-pi))<0. 

Since / is continuous and non-decreasing, there exists k > and 77 > such that if 
a(i) < ao + ry, then /?(i) > k and if a(i) > 1 — pi — 77, then /3{t) < —k. 
As a consequence, we deduce from Equation (^J) that 

^(^)^- fo(oIf,(^) 

Thus, if a(0) G [ao -I- 77, 1 — pi — 77], a(t) G [ao + 77, 1 — pi — 7;] for all < > 0. 
For alH > 0, we have 

Foit) + Flit) < Fo(0) + Fi(0) + (Ao + Xi)t, 
< l + (Ao + Ai)t, 

and we deduce that if a(0) is in [0, ao -I- 77] and as long as a(i) stays in [0, ao + 77], 
we have 

, , nds 
ait) > 



l + (Ao + Ai)s 
> -^^log(l + (Ao + Ai)0. 

Ao + Ai 
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Figure 3. Dynamics of {Fo{t), Fi{t)) 

Similarly, if a(0) is in [1 — pi — 77, 1] and a(t) stays in [1 — pi — rj, 1], we have 

/■* nds 
"^^^-'"io l + (Ao + A,). 

< 1--^— log(l + (Ao + Ai)i). 

We then define 

1 /max(ao + 77,pi +77)(Ao + Ai)\ 

Ao + Ai V K J 

and if a(0) G [0, ao + 'y] U [1 - pi - ?7, 1] then a(Ti) £ [ao + »?, 1 - Pi - v]- Finally, 
for all t >Ti, a{t) € [ao + 77, 1 — pi — 77]. 

Now, we know that a{t) will reach [ao+rj, 1— pi —77] in finite time and stay in that 
interval; we just have to study the behavior of F when a(0) is in [ao + ?7, 1 — pi — ??] . 
Using equations ([T8| and (|19p. we have that, if q;(0) € [ao + '7i 1 ^ Pi ^ J?], then, for 
all t > 0, 

i^oW < -MO {f{ao + v)-Po) < 0, 
Fi{t) < -Pi?? 

and the two components decrease at least linearly to in finite time. There exists 
T2 such that for any fluid hmit, for all t > T2, F{t) = and thus Z{t) ==0. □ 
The dynamics of {Fo(t), Fi(t)) described in this proof is represented in Figure 
[21 Theorem [T] gives a sufficient condition for stability. The next theorem gives a 
sufficient condition for transience. The arguments of the proof are very similar. 

Theorem 2. Consider a linear network of L links of capacity 1. // there exists ko 
in {0, . . . , L} such that pk„ > 1 or, if for all k in {0, . . . , L}, pk < 1 and 

po > sup 4>o{x), 

0<x<l-pi 

then the network is unstable, i.e., {N{t)) is transient. 
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Proof. In order to prove the transience of the process, we just have to prove that 
there exists a time T such that after T, any fluid Hmit {Z{t)) increases hnearly (see 

We consider a fluid limit {Z{t)). If there is a fco such that Zkg{0) > then 
Equations ([6]), (O and ([8]) are valid. It is obvious that, if there exists fco such that 
Pkg > 1 then {Zk{t)) increases linearly and the process {N{t)) is transient. 

We suppose now that pfe < 1 for all fc in {0, . . . , L}. In that case, there is a time 
To such that, for all fc in {2, . . . , i} and t > To, Zk{t) = 0. According to the strong 
Markov property, we just have to study the fluid limits such that Zk{0) = for 
2 < fc < L. In that case, Zfc(i) = for 2 < fc < L and we just have to study the 
dynamics of {Zo{t), Zi{t)). 

We define the following function 

g{a) = sup (l>o{x). 

0<x<a 

This function is continuous, non-decreasing and, for any a in [0, 1] satisfies g{a) > 
(f>o{a). We also define the process {G{t)) such that G(0) = Z{0) and 



(22) Goit) = Xo - fiog 

(23) Gi(i)-Ai-/ii 



Goit) 



Goit) + Gi{t) 
Go{t) 



Goit) + Giit)- 



As previously, we can prove that, for all i > 0, Go{t) < Zo{t) and Gi{t) < Zi{t). 
So, we just have to prove that the process {G{t)) increases linearly to infinity in 
order to prove the transience of {N{t)). 

We define ag = min{a e [0,1], g{a) = po}. Since po > g{l — pi), we have 
ao > 1 - Pi- Define a{t) = Go(t)/(Go(i) + Gi{t)). 

As in the proof of Theorem [l] we can show that there exists 77 > such that, 
for any initial state a{0), after some finite time Ti, a{t) reaches and stays in [1 — 
pi + rj,ao — rj]. We then just have to study the dynamics of G when a{0) is in 
[I- Pi+ 77,0:0 - v]- 

Using equations and ([25)1 . we have that, if a{t) G [1 — pi + 1], — then 
Goit) > Po {po - g{ao - 77)) > 0, 
Gi(t) > pirj. 

Thus, for any initial conditions, for all t > Ti, G{t) increases linearly to infinity 
and the theorem is proved. □ 
The dynamics of (Go(t), Gi(t)) described in this proof is represented in FigurelH 
In particular, we can remark that when the network is unstable, there is always a 
time after which both classes and 1 of the fluid limit increase linearly to infinity. 

Remark 1. The stability region of the network is not reduced to {0} since infi_pj<j;<i ^0(2;) > 
when pi < 1 and it is strictly included in the optimal stability region since 
suPo<x<i-pi 4>o{x) < minfe(l - pk). 

Corollary 1. Consider a linear network with two links of capacity 1. 
This network is stable if pk < 1 for all < k < 2 and po < (t>o{l — pi) ■ 
This network is unstable if there exists fco in {0,1,2} such that pk^ > 1 or if 

Pk < 1 for < fc < 2 and po > 4>o{l — pi). 
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Figure 4. Dynamics of {Go{t),Gi{t)) 

Proof. All that we have to prove is that the function (po is strictly increasing. 

Consider the functions (j)o, (j)2, the processes (A^2*(0) their stationary distri- 
bution tt" as defined in section [331 We assume that p2 <l- 

The process (iVI'C^)) one-dimensional and for ai < a2, for all n2, (j>k{cti, "-2) > 
^k{a2,n2). This implies {1^2'' (t)) >st {N2'it)) and dominates n^'K 

For any a g [0, 1] and any 712 G N, 

0o(a,"2) + 4>2{a,n2) = min(n2a2 -|- a, 1). 

The function n2 1— (/)o(Q!,n2) + 4'2{<x,n2) is therefore non-decreasing. 
Applying the definition of stochastic domination, we have 

IE#"i (f^oCai, ■) + 02(ai, •)) < IEjr»2(0o(ai, ■) + <^2(Q!i, •))■ 

For any n2 £ N, we have ^0(^2, n-2) -I- 1^2(02, ^^2) > 0o(ai, '^2) + 02(ai, »^2)- Since 
ai < a2 < 1, we have (/)o(ck2,0) > (/)o(ai,0) and we can conclude 

IE#"i (^o(ai, •) + 02(ai, ■)) < IEs-°2(0o(a2, •) + '^2(a2, •))■ 

Using the fact that E#a ((/)2(a, .)) — p2, we can conclude that if ai < a2, then 
0o(ai) < 0o(a2)- □ 

4. Asymptotic stability 

From the results of the previous section, we know that ergodicity conditions in 
general depend on the access rates Uk ■ In this section, we qualify this dependence as 
the access rates become asymptotically small. In the next subsection, we introduce 
a scaling on the access rates in order to understand the qualitative behavior of 
networks when the access rates become small. In subsection 14. 2 [ we use this scaling 
to determine the limit of ^0 when the access rates tend to and then deduce that 
linear networks are asymptotically optimal. In subsection 14.31 we use the same 
scaling to determine the asymptotic optimality of upstream trees. Subsections 14.21 
and 14.31 are independent. 
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4.1. Scaling over the access rates and flow sizes. We fix all network param- 
eters except the arrival rates, the mean size of flows and the access rates. For each 
/3 G N, define the process (A'^(t)) describing the evolution of the number of fiows 
in each class in a network where the access rate of each class k becomes afc//3, the 
arrival rate becomes Afc/3 and the inverse of the mean size 

In this proof and in the proof in the appendix, we will need the definition of an 
increasing process of a martingale. If (M(t)) is a square-integrable martingale on M 
null at 0, {{AI)t) is the (essentially unique) increasing process such that (M^(t) — 
{M)t) is a martingale. If (M(t)) and {N{t)) are two square-integrable martingales 
on R null at 0, {{M,N)t) is the (essentially unique) increasing process such that 
{M{t)N{t) ~ (M, N)t) is a martingale. For more information on martingales and 
increasing processes, see (22j . 

Theorem 3. Consider an acyclic network with L links and K classes. 
If 

lim laQNp{0)^X{0), 

then {l3~^a Np(t)) converges in probability uniformly on compact sets to {X(t)) 
such that 

(24) Xk{t)=akXkt-ak^^kMXit)), forl<k<K. 



The convergence mentioned in this theorem is the uniform convergence in prob- 
ability on compact sets for the space IJrn ([0, oo)) with Skorohod topology (see [1 ). 
Proof. We define the process {Mp{t)) such that 

(25) M,At) - a, - - X,t + (^a iV,(.)) d.) , 

for 1 < k < K. The martingale characterization (see [23]) of the Markov jump pro- 
cess {P'^aQNpit)) shows that (M^(i)) is a martingale and its increasing processes 
are given by, for 1 < fe, / < L and k ^ I, 

(26) {M(!,k)t = J (^Xkt + Aife ^ Vfe © ds^ , 

(27) {Mp,k,Mp,j)t=0. 

Since ipk is bounded by a constant C, we have {Mp^kit < ak{Xk + CpLk)t/ for 
t>Q. 
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As {Mij{t)) is a martingale, we can use Doob's inequality. For any t > and 

£ > 0, 



0<s<t / \0<s<t 



K 



sup ||M^|U(s)>e <^P sup \\Mfi^k\\oo{s)>e 



S k 

K 

< -5-max(M,3,fe)t, 

£ k 



t1 

Kt 

7^ "T 



Thus, (Mfj{t)) converges to in probability uniformly on any compact when /? — > 

+CXD. 

We now consider the random variable supQ<^<f \\f5~-^a Q Nfj{t) —X{t)\\^ and 
show that it converges in distribution to 0. Define Zp{t) = P'^a Np{t) - X{t). 
Using (USD, 

Zf},k{t) =^a iV^,fe(0) - Xk{Q) + Mp^k{t) 



fJ-k 



Ai^aQ Np{s) ] - MX{s)) ] ds, iorl< k<K. 



The ipk are all K-Lipschitz for some k > and, for I < k < K , 



(28) 



sup \Zii^k{s)\ < 

0<s<t 



/3 



■iV^,fe(0)-Xfc(0) 



sup \Mp^k{s)\ 

0<s<t 



+ K^k / sup \Zi3{u)\ds. 

Jo 0<u<s 



Define the function 



fp{t)=E[ sup \\Zi3{s) 

\Q<s<t 



Using ([28| . ([26l) and (|27|) . we deduce the inequality for all s < t, 
1 



Ms) < 



13 



aQNp{0)-X{0) 



+ ^ (a + /i) s + A 1^ fp{u) du 



where a = max^ Ofe, A = max^ Afe and /t = max^ /i^. 
Applying Gronwall's lemma (see [TT|). 



^aQNp{0)-X{0) 



t e 



fit 



Thus, ffj ^ a.s (3 +oo and supQ<^<t ja Af^(s) — -'^(s) 
distribution to 0. In particular, for e > 0, 



converges m 



lim If I sup 



-aeNp{s)-X{s) 



> e = 0. 
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Hence, (/3~^a Af^(t)) converges to {X{t)) in probability uniformly on compact 
sets. □ 

The processes {f3~^a iV^(i)) converge in distribution, as f3 tends to infinity, to 
a process {X{t)) which is completely deterministic. This process has a fixed point 
if and only if there exists x e R;^ such that 

(29) Xk-^^kMx)^0 foTl<k<K. 

Proposition 4. Consider an acyclic network with L links and K classes. 

{X(t)) admits a unique fixed point if the optimal stability conditions (|4]) are 
satisfied: 

Pk <Ciiovl<l<L. 

kderk 

Conversely, if there exists a link Iq such that 

then {X{t)) does not admit a fixed point. 
Proof. 

By definition of acyclic networks, we suppose that the links are numbered in a 
such a way that the links on a route of any class are an increasing sequence. By 
definition, any fixed point x ~ (xi, . . . , xk) satisfies 

ipk{x) = Pk, ior 1 < k < K. 

We first suppose that the optimal stability conditions (|4]) are satisfied. First, 
note that if a; = (xi, . . . ,xk) satisfies the optimal stability conditions, then for all 
k, ipkix) = Xk- The traffic intensities (pi, . . . , px) are then a fixed point and this 
is the only fixed point which statisfies the optimal stability conditions. 

On the contrary, if x is such that there exists Iq with 

Y Ci„, 

k-.lo&k 

then, there exists li which is saturated i.e. 

E (^k{^) = cu. 

kdi erfc 

Since the network is acyclic, without loss of generality, we can assume that li is 
such that, for all I > h, link I is not saturated i.e. 

In that case, for all class k such that Z G r^, we have ipkix) = 0\}{x) and 

E i^k{x) = Ci, 

k-.h^Tk 

> E 

The vector x cannot be a fixed point and the uniqueness of the fixed point is proved. 
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We now suppose that there exists a link Iq such that 
In that case, it is enough to remark that, for all x = (xi, . . . , xk), 

There is no fixed point. □ 
This proposition brings the intuition that the stability conditions for any acyclic 
network can be arbitrarily close to the optimal ones if the access rates are small 
enough. In the remainder of this section, we prove that this intuition is true in the 
case of linear networks and upstream trees. 

4.2. Asymptotic stability of linear networks. We return here to the linear 
networks discussed in Section [3] Theorems [T] and [2] show that stability conditions 
depend on the function 0o a-nd consequently on stationary distributions (tt"). In 
order to characterize the ergodicity conditions, we have to study the evolution of 
these distributions when the access rates decrease to 0. 

Consider the process [N^.i^it)) introduced in Section [231 for a £ [0,1] under 
the scaling defined in Section [4.11 We call (^^^,^(0) the scaled process whose 
transition rates are given by, for 2 < k < L, 

Uk Uk + I : PXk, 

Uk ^ Uk - I ■■ f^fiki^kin (3~'^a) 

where the functions V'fc are defined by Equation ^TU\i . We suppose that the ergod- 
icity conditions of this process are fulfilled, i.e., p/c < 1 for 2 < k < L, and denote 
by TTp the stationary distribution of {/3~^a2:L © pi'^))- 

As in Section [01 when /3 tends to infinity, the processes {/3~^a2:L (li^)) 
converge in distribution to a deterministic limit that we call (A"(t)). This process 
has a unique fixed point that we call 7(0;) which is the solution of the following 
equations: 

Afc - ^iki^kia, X2:l) = for 2 < /c < L. 
Using the definition of ij^k, 7(0;) can be built recursively yielding: 

(30) lk{c») — max ^pfe, —J^ — - min ^a, min (1 — '^■'-^^^ 2 < k < L. 

The next proposition states the convergence of the stationary distributions tt" 
to the Dirac measure at 7(a) for all a G [0, 1] and the convergence of ipQ. 

Proposition 5. Consider a linear network with L links in the quasi stationary 
regime. The set {tt^, a £ [0, 1], /3 G N} is tight. For any a G [0, 1], the stationary 
distribution (tt^) converges to <5-y(Q) when j3 +00. 
If (j)Q^p is the function such that 



(31) (j)Qjj{a) = / V'o(a, a;2:L)7r"(da;2:L), /or a S [0,1], 
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then 00, /3 converges pointwise on [0, 1] to 

(32) 00,00 '■ OL I— min a, min (1 — p^) ) , when (3 +oo. 

' \ 2<k<L 



Moreover, for all a e [0, 1], 



lim inf 0o,/3(u) = 4>o,ao{a). 

/3— >+oo a<u<l 



The tightness and the convergence mentioned in this proposition is the conver- 
gence of probabihty distributions on R^~^ with the usual topology. Proof. First, 
we have to prove that the set {tt^, a e [0, 1], /? 6 N} is tight. 

Note that for a G [0, 1] and for k>2, 



13 + UkOk 

Define the Markov processes (A^2:L./3(i)) with transition rates: 

Uk ^ Uk + 1 ■■ Afc/?, 
Uk ^ Uk - I ■■ HkP- 



Ukttk 

We assume that A^2:L,/3(0) = N^:L,pi^)- We then have (/3"^a2:L A^2:L,^j(i)) >st 
(/3"^a2:L N^:lA^))- In order to prove that the set {tt^, a £ [0,1], /3 £ N} is 
relatively compact, it is enough to prove that {tt/j, /3 G N} is tight where Trp is the 
invariant measure of (/3~^a2:L -^2:L,/3(0)- These are birth-death processes whose 
components are independent. Their invariant measures thus have a product form 
and it is sufficient to study the one-dimensional case: 

r(^ + l + n2 



n2l 



where F is the usual gamma function 

iZ-l-t 



T{z) = / e-'e-^dt, for ^ > 0. 
■kp is a negative binomial distribution and we have 

Thus, if A>p2/(1-P2), 

(33) lim 7r«([A,+oo[) = 0. 

Fix e > and A> p2/{l — P2)- According to (1551) . there exists /3o G N such that 
for all /3 > /3o, 7r^([0, A\) > 1 — e. Additionally, there exists a compact Fi C M such 
that for 13 < /3o, TrpiTi) >l-e. By choosing F = [0,A]UFi, we have 7r;3(F) > 1-e 
for all /3 G N and the set {tt^ , /3 G N} is tight on M+ with the usual topology. 
Finally, the set {ttS, a G [0, 1], /? G N} is tight and, thus, relatively compact. 
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We now prove the convergence of the invariant measures. The infinitesimal 
generator fi^ of {l3^^a2:L pi^)) defined by 



k=2 
L 



+ X] /^AifcV'fc(a, X2:l) yf \^2:L ^ ^ ^ {x2:l) 

The "infinitesimal generator" f2" of {X°'{t)) is defined by 

^°'{f){x2:L) ^Y^k-Q {x2:l) " ^ A^fcV'fc («, X2:L ) ^ ix2:L)- 

k=2 k=2 

Let / be a bounded smooth function with a bounded derivative. Since {tt^, (i G 
]0, 1], a G [0, 1]} is tight, for any e > 0, there exists a compact set F C M^~^ such 
that for aU /3 in N and a in [0, 1], 

(34) / f{x2:L)^1{Ax2:L)<£- 

Since / and its derivative are bounded and the ij^k are 7-Lipschitz for some 7, 
there exists 77 such that for a; in F, 

(35) Wp{f){x2:L)~^''{f){x2:L)\<^- 

The equilibrium equations give, for all a, 

(36) / n%{f){x2:L)^${dX2:L)=Q. 

Since {tt^, /3 G N, a G [0, 1]} is relatively compact, we can extract a convergent 
subsequence [t^'^I) such that ai ^ a and (3i +00. Thanks to relations (l34l) . (1351) . 
P6p and the continuity of / and its derivative, we can write that 

lim / ii"^(/)(x2:L)^2'(dX2:L) = / (/) (a;2:L )7f " (dX2:L ) • 

Finally, (tt^') converges to ff" when (3 +00. 

The convergence pointwise of 0o,^ follows by choosing ai — a. 

Finally, for the last part of the proposition, we consider a sequence (a^, Pi) such 
that at — >■ aoo, ft — ?• +00 when i — >■ 00 and, for all i, 4>o,i3i{ui) = infQ<ti<i 0o,ft('"). 
We have that 

lim ^o,/3i(ai) = '^o,oo(aoo)- 
By construction of a^, we also have 

Since 00,0 is a non-decreasing function, its implies that 

lim 0o,ft(ai) = 00,00 (a). 

□ 

We finally deduce the following theorem which is a consequence of Theorem [T] 
and Proposition [S] 



STABILITY OF NETWORKS WITHOUT CONGESTION CONTROL 



21 



Theorem 4. In a linear network with L links, for any traffic intensities {po, . ■ ■ , Pl) 
satisfying the optimal stability conditions ([5]), if the access rates {a{),...,aL) are 
small enough, the resulting stochastic process is ergodic. 

Proof. We consider the scaled version of the process introduced in Subsection 14. II 
(7V^(i)). According to Theorem [TJ a sufficient condition of stabihty is 

Pfc < 1, for < /c < L, 
Po < inf ^o.^(a). 

1 — pi<a<l 

Since traffic intensities [p^,. ■ ■ , Pl) satisfy optimal stability conditions ([S]), there 
exists £ > such that 

Pfc < 1, for < A: < L, 
Po < nrin (1 - pk) - e. 

l<k<L 

According to Proposition [5l there exists /?o such that for all /? > /?o, we have 
inf >o,/3(a) > min (1 -pfc) -e/2. 

l — pi<a<l l<k<L 

This implies that, for all (3 > /3o, the process {Nfj(t)) is ergodic. 

Finally, to conclude, it is enough to remark that the process with transition rates 

Uk ^ nk + I ■■ Xk, 

Uk ^ Uk - I ■■ pki^kin Q P"^ a) 

admits the same stationary measures as {Npif)) and is then ergodic if and only if 
{Nfs{t)) is ergodic. □ 
This result means that the Tail Dropping policy is asymptotically optimal in 
linear networks. Figures [5] and |6] represent the stability region for classes and 1, 
obtained by simulation, for two particular networks and illustrate this result. 




Access rates of cla 


3ses 2,3,4: 




1 

0.1 
0.01 









Figure 
5. Stability 
region for 
classes and 1 
when L — 2 and 
P2 = 0.5 



Figure 
6. Stability 
region for 
classes and 1 
when L ~ 4: and 

P2,P3,P4 = 0.5 
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4.3. Asymptotic stability of upstream trees. Upstream trees are a specific 
class of networks because they are monotonic and this will allow us to use stochastic 
domination to establish the asymptotic stability of upstream trees. Thanks to the 
monotonicity, the worst case, in the sense of stochastic domination, for a given 
class is when there is an infinity of flows in all other classes. When the optimal 
stability conditions are satisfied, we can prove that there exists a class fco which 
can get enough bandwidth to be stable even if there is an infinity of flows in all 
other classes. Thanks to the same scaling that we use in subsections 14.11 and 14.21 
we are able to quantify the bandwidth used by the class ko when the access rates 
are decreasing to and to prove that there exists a class ki which is stable when 
the access rates are small enough even if there is an infinity of flows in all classes 
except ko and ki . We conclude by using a recursion. 

In upstream trees, when two different classes go through the same link, they 
share the same path until they exit the network. The last link on the path of all 
classes is the same and it is called the root. Formally, upstream trees are defined 
as follows: 

(i) : a common root link, say 1, so that rk{dk) = 1 for all classes k; 

(ii) : for any two classes j and fc, there exists m such that they only have their 
last m links in common; i.e, for i in {0, . . . , m — 1}, rj(dj — i) = rk{dk — i) 
and for ik in {0, . . . ,dk — m} and ij in {0, . . . ,dj — m}, rj{ij) ^ rk{ik)- 

Two examples of upstream trees are given in Figure [71 In [4] , two very specific 
examples were shown not to be ergodic under optimal stability conditions except 
when the access rates tend to 0. We generalize this result. 




Figure 7. Examples of upstream trees 



For any link let Si denote the set of children of /, the links just before I on the 
path of some class: 

Si = {j e{l,...,L}, 3fce {!,..., if}, 3i, rfcW=j,rfc(* + l) = /}. 

In particular, is the set of links which are the links just before the root link on 
the path of all classes with a route of length longer than 1. 

We suppose that there are no two classes with exactly the same path. We also 
suppose without loss of generality that all the links of the network can be saturated. 
For any link this implies that there is a class ki directly entering in the network 
through that link, i.e., r^, (1) — I or J2jes, > C*;. If a link Zq cannot be saturated 
then the bandwidth allocation is the same with or without Iq and we can remove 
it. 

Upstream trees are monotonic in the sense that if n G N^' and m G N^^ and 
"T-fe — nk for a given k and rrij > rij for j ^ k then (jjkim) < (pkin). Thanks to this 
monotonicity property, the processes we study fit into the framework of [S]. We 
suppose that the traffic intensities satisfy the optimal stability conditions (0]). 
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Because of the monotonicity of this network, we know that the worst case for 
class ko is when the numbers of flows in ah other classes increase to infinity. We 
define the following allocation: 

(37) Voifco G E+, (a;fej = lim inf ipkoiv) 

" ri^Qcy-ykQ—xkQ, 

and is such that (f^lginkg) = V'fco (afco"-fco) '^feo ^ We then define the 

Markov process (7V^^(t)) such that A^^^(O) — Nj.g{0) with the transition rates 

nko nko + l ■ Afco , 

Because of the monotonicity of the considered allocations, we have that the process 
(7V^^(t)) stochastically dominates {Nko{t)) (see [5]). 

In the sense of the stochastic domination, this process represents the worst case 
for class fep. The next lemma shows that there is a class which is stable even in the 
worst case. 

Lemma 2. Consider an upstream tree and suppose the traffic intensities of this 
network respect the optimal stability conditions There exists a class ko such 

that the Markov process (A^^^(i)) is ergodic. 

Proof. Because of the monotonicity of the network all that we have to prove is 
that there exists a class fco such that 

(38) lim inf (t>k„in) > Pko- 

If fco satisfies ([55)1 then there exists e > and r/o such that, for all nk^ > 770 : 

Afeo - l^k„(f>l„{nko) < -£• 

This implies the ergodicity of (iV^^(t)). We proceed by recursion on the depth of 
the tree. 

If the depth is 1 then there is a single class and a single link and condition ([55)) 
is obviously true. 

We suppose now that the depth of the tree is d > 2. If there is a class fco such 
that rko{l) — 1 then the root link is the entry point of fco which is the only one 
entering the network through 1. The worst case for class fco is when all links in 
are saturated; we have for all n G , 

4>ko{n) > min akoTiko^Ci— '^^f!^" . 

Because the optimal conditions are satisfied, we have pk„ < Ci and there exist 
S > and rjo such that for all n G with Ukg > rjo, we have 

(pko (n) > pk„ + S 

which is enough to conclude. 

We now suppose that there is no class directly connected to the root, i.e. there 
is no class fc with a path of length 1. This implies that Si is not empty. Since 
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the root link can be saturated, we have J^ies Gi > Ci. Due to optimal stability 
conditions, we have 

K 
k=l 

and we can deduce that there is a link in 5*1 such that 

E P'^ < y-^^- 

Since the link Iq can be saturated, there is a constant 770 such that, if for any class 
k going through Zq (i-e- satisfying rk{dk — 1) = ^o), we have Uk > ?yo, we have 

E a) = 

fe:rfc(dt-l)=/o 

Using the monotonicity of upstream trees, we can deduce that the worst case for 
classes going through Iq is when all the other links in 5"! are saturated. We deduce 
immediately that when nk > 770 for all k going through Iq, we have 



Ci 



It remains to consider the case where all the links in Si are saturated corresponding 
to the case of equality in the previous equation. With these conditions, the subtree 
whose root link is Iq is equivalent to an upstream tree where the capacity of link Iq 
is replaced by CiCiJ{Y,j(,Si Q)- 

If there is a class ko such that dk^ — Iq then, as previously, we have 

lim inf (n) > ^i^'o ^ 

and fco satisfies ([55]) . 

If there is no class feg such that dk^ — Iq then Si„ is not empty and, as previously, 
we can find h such that 



E Pk < Ci^— — - 



k:rk{dk-2)=h 

Using a recursion, we finally find fco satisfying psp . In addition, the links on the 
path of fco satisfy 

dk„ C ( ) 

(39) V7e{l,...,4o-l}, E Pk<Cr,„i^) n 

fc:rfco(i)erfc j=i+l ^'S'S'.^oO) ' 

□ 

We now perform the scahng of Section H?T] on the process (iV^^(i)) and call the 
scaled process {N^^ p{t))- We deduce from the above lemma that the scaled process 
is ergodic for all /3 e N. For each /3, we call tt^^ ^ the stationary distribution of 
{P^^akoNlgjjit)). As in Section 14711 the process [P^^ako^ko.ii^^)) converges in 
probability uniformly on compact sets to a deterministic process (X^^(t)). The 
next lemma shows that there is also convergence for the stationary distribution. 
The proof of this lemma is similar to that of Proposition [3] and is omitted. The 
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tightness and convergence in distribution mentioned in this lemma are on the space 
R+ with its usual topology. 

Lemma 3. Consider an upstream tree and suppose that the optimal stability con- 
ditions Q are satisfied by the traffic intensities. Consider ko such that {Nl^{t)) is 
ergodic. The set {tt^^ fj^P ^ ^1 tight and tt^.^ ^ converges to where is 
the unique solution of the following equation 

(40) Afc„-Mfc„^i„(4j = 0. 

The function i^j,^ is defined by Equation (j37p . 

Now, we proceed by recursion. First, we exhibit a class fci which is also stable 
when the access rates of classes ko and ki are small enough whatever the state of 
other classes. For any classes fco and fci, define the following allocation 

(41) W{xko,Xk,) eM.\, ^l {xko,Xk,)= lini ,,.,inf ^koi^) 

Vki =^ki 

and V-'fci is defined similarly. Now define (p^^ and such that (j>\^ (uko , fifci ) = 
■0^^(afconfcn,rifeinfcj for all {nko,nk,) in N^. Let {N^^{t), N^^{t)) be the Markov 
process with the transition rates for i = 0, 1: 

"fc, nki + 1 : Afc, , 

nk, nki - 1 '■ Mfci^fc, (n-fco:'^fci)) 

and such that (iV^^ (0), TV^^ (0)) = (A^fc^ (0), ^fci (O))- Using the monotonicity of 
the considered allocations, we know that process (iV^^ (t), iV|^ (t)) stochastically 
dominates [Nk^ {t),Nk^ {t)). Again, let (7V|^ ^(i), N'^^ i^{t)) denote the scaled version 
of«(0,<W). 

Lemma 4. Consider an upstream tree and assume that the optimal stability con- 
ditions Q are satisfied by the traffic intensities of this tree. Consider ko as defined 
in Lemmas\M and\^ 

There exist ki and /3i G N such that, for all 13 > Pi, the Markov process 
i-^ko ^(^)'-^fci /3(^)) ergodic. When /3 > the Markov process 

{r'akM,At),r'ak,Nl,M 
has a unique stationary distribution that we denote by tt^^ ^.^ ^ . The set 

is tight and the stationary distribution tt^^^ ^.^ ^ converges to (5(-q,2 ^2 ^ where (a^.^ , a\_^ ) 
is the unique solution of the equations 

The functions ijjf.^ and ■0^^ are defined by Equation (|41l) . 

The tightness and convergence in distribution mentioned in this lemma are on 
the space Ml with its usual topology. 



(42) 
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Proof. First, we prove that there exists ki such that 
(43) hin iPl^{al^,Xk,) > Pk, 



where aj,^ is the unique solution of (l40l) . 
For all i in {1, ... , dhg}, We define 

% (xko) = lim inf ei {y). 

k^ko,yk>V 

Using Lemma [31 we can prove 

The quantity cr^ is the bandwidth used asymptotically by class feg in link rk.g{i) 
when all the other classes are saturated and when the access rate atg decreases 
to 0. We want to prove that when Ukg is small enough, class ko leaves enough 
bandwidth for other classes. First, we have the following result which states that 
the optimal stability conditions are met by all classes except ko when we remove 
the bandwidth asymptotically used by class ko in the saturated case: 

e {1, . . . ,dfej, Pk < Cr.Ji) - (Ti. 

k:rkg (i)&k 

Indeed, for link 1, note that (Td^^ — Pko because is the solution of Equation 
(|40p and the previous inequality is obviously true for link 1. If the route of ko is of 
length 1 the lemma is proved. 

Suppose that the route of fco is at least of length 2. By construction of ko, there 
is no class entering the network through rko{i) for i in {2, . . . , dko}- Since any link 
can be saturated, this implies 



Moreover, we can prove that 



/es,^ (i) 



Vl e {!,..., dfc„ - 1}, cr; = [[ — ° — Pko- 

j = i+l ^^kgU) 

Using these last two equations and Equation ([5^ . we deduce 

Vi e {1, . . . ,dfco - 1}, Y Pfe < C'rfc^(j) - CTj. 

Considcring, for all k ^ ko, the allocation 

(xo, . . . , Xfco_i, Xfeo+i, . . . , xk) ^^k{xo,.-.,al^,..., xk) 
and using the same procedure used to find ko, we can find ki such that 

lim inf Vfei {x) > Pk, 

r;->oo k=iikoXk>V 

which is equivalent to Equation 

We are now able to prove that there exists /3i e N such that for all /? > the 
Markov process (iV^^ ^(Oj-^fci /3(*)) is ergodic. By construction of (iV^^ ^{t)) and 
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i^ko ^(^)' ^fci ^(*))' according to Theorem 2 of [5], we just have to prove that there 
exists /3i G N such that, for all (3 > /3i, 

(44) pk, < E^i ^ fliminf ^2 7Vi,.^(0),a;,,)) . 

We deduce from (|43| that there exists b > , > and rjo such that 

(45) Wxko < b, > r/o, {xko,XkJ > pki + 

We know that tt^^ ^ converges to (J^i when /3 — > +oo. Thus, there exists /3i E N, 
such that, for all /? > /3i, 

(46) 7fi„,^([6,oo[)< 



2(pfci + ^) ■ 

Finally, we have that, for all /3 > (3i, Equation (|44t is satisfied and the process 
(^lo,/3W'^fci,/j(*)) isergodic. 

We now prove tightness. By construction, we have {N^^ ^(^)) ^st i^ko pi^)) ^^'^ 
we deduce immediately that 

(47) Vc e M, nl^,^^^{[c, oo[xK) < 7fi^_^([c, oo[). 

Moreover, according to Equations pS)) and for all /3 > there exists a 

process (Y3(i)) such that (y^(t)) >st (-/V|^ ^(0) with the following transition rates 

nki riki +1 : /3Aa;i, 

"-fei ^ rifej + 1 : /3 (^Afej + ^Aifei) l{r;3(t)>i7o/3}- 

(y^(t)) has the transition rates of a A4/M/1 queue with [770/?] permanent clients. 
Let T^Y,ij denote the stationary distribution of {jS^^Ypit)) and we obtain immedi- 
ately that 



V/3 > /3i, V?7 > r/o, ■nY,p{[n, oo[) < 



X \ L('?-'?o)/5J 



< 



X \ L('?-';o)/3iJ 



We deduce from the previous equation that 

/ \ \ L(';-';o)/9iJ 
(48) V/3 > /3i, Vr; > ,70, >< I^' °«]) < IT^^^ 

The tightness of {tt^^ p, /3 > follows from Equations (H71) and and 
the tightness of {TTfco,/}, /3 G N}. 

We can remark that existence and uniqueness of the solution of Equation 
come from the monotonicity of {ipl^ , 'tpl^ ) and from Equations and (^5]) . 

The proof of convergence is similar to that used in the proof of Proposition [S] □ 

Using a recursion we can easily generalize the previous lemma. The principle is 
still the same: little by little, we decrease the access rates and the classes become 
stable one by one. In particular, there exists f^K-i G N such that for all /3 > 13k -1, 
the process (iV/3(t)) is ergodic where (iV^(i)) is the scaled version of {N{t)). We 
can therefore state the following. 
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Theorem 5. In an upstream tree, for any traffic intensities satisfying the optimal 
stability conditions (jl]), there exist positive access rates small enough such that the 
resulting stochastic process is ergodic. 

Appendix 

Appendix A. Proof of Proposition [3] 

We first give a sketch of the proof. The technical details are proved in the lemmas 
which follow. 

We consider the process (iV(m,t)) = {{Noifn^t), Ni{m,t), . . . , Nk{m,t))) such 
that, for all < fc < L, 

Nk{m,0)^P^ and Nkim,t) ^ ^Nk{\\m\\t), for t > 0. 
||m|| ||m| 

We consider a sequence (m*, i G N) such that 



lim ||m*|| — +c», lim 



'0 



(49) , " / 

lim = 1 - a, lim = 0, for 2 < fc < L. 

i^+oo \\m^\\ i-f+oo \\m^\\ 

We want to prove that the sequence of processes (7V(m*, t)) converge and to char- 
acterize the limit. For that purpose, we write them as the sum of a martingale term 
and a continuous term and we define the process (M(m, t)) such that for t > and 
< fc < L, we have 

Mkim,t) ^Nkim,t) - ^ - X^t 
m 

(50) 



+ fik / (t)kiNo{rn,s),Ni{m,s),N2{\\m\\s),...,NL{\\m\\s))ds. 
Jo 

Because the access rates oq and ai are equal to 1, we have 

Vn e N^, 7 e R, 0fc (7no,7^M,?i2, ■■■,nL) = (t)k (»^o, »^2, ■ ■ ■ ,nL) 

If ao and oi are not equal to 1, the previous expression is true outside a compact 
set and it is possible to prove all the results in this section without this assumption 
because, at a fluid level, the flrst link is always saturated. 
In Lemma EJ we prove that the set 

C = {{N{m\t)), i e N} 

is relatively compact and its limiting points are continuous. We can now extract a 
converging subsequence and we suppose that (m*) is such that (./V(m*, t)) converges 
in distribution to a limit that we denote {Z{t)) = {ZQ{t), Zi{t), . . . , ZL{t)) and 
which is continuous. In lemma [6l we characterize {Z2{t), . . . , Z^lt)) by proving 
that, for 2 < fc < i and i > 0, Zkit) = 0. 

Proposition [6] is the key result in order to understand the time scale separation 
between classes and 1 and classes 2, . . . ,L. We deduce from this lemma that 



ft 



'0 



(t>k {Nn{m\s),Ni{m\ s), A^2(||mls), . . . , NL{\\m'\\s)) ds, fc = 0, 1 
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converges in distribution to 



Zo{s) + Zi{s)J ' Jo Zo{s) + Zi{s) 



ds, / - ds 



where (/)o characterizes the average throughput of class in the quasi-stationary 
case as defined by Equation PT|) . 

We can deduce from that and the fact that (M(m',t)) converges to in distri- 
bution that {No{m\t), Ni{m\t)) converges in distribution to 



Zo(0) + Aot - MO / ' 4>o L .fit t ^i(O) + Alt - Ml /' ^'^'l ds 

Zq(s) + Zi[s)J Jo Zq[s) + Zi(s) 



and we conclude that, almost surely, 



Zo{t) = Zo(0) + Xot - Mo / 4 ( ^ , , , 1 ds. 



Zi(t) = Zi(0) + Ait-Mo ^ . fi'^ . . ds, 

Zk{t) = 0, for2<fc<L 
holds for all t in R+. 
Lemma 5. 

C = {(iV(m^^)), i G N} 
is relatively compact and its limiting points are continuous processes. 

Proof. The method used here is also standard. We define Wh the modulus of 
continuity for any function h defined on [0,T]: 

Wh{S) ^ sup \h{s) - h{t)\. 

s,t<T; \t-s\<S 

As in the proof of Theorem [3l we can prove that {M{m, t)) \s a. martingale and 
its increasing processes are given by, for < k,l < K with k ^ I, 

{mm, t)) = ^4 + Tr4 r 0fe(^o(m, s), 7Vi(m, s), iVsdImp), . . . , NL{\\m\\s)) ds. 



{Mk{ni,t),Mi{m,t)) ^0. 

Since the functions (pk are bounded by 1, we deduce that 

{Mk{m,t)) < — . 

Il'^ll 

By using Doob's inequality, we have that, for e > 0, 

sup ||M(m,s)|| > e") < sup |Mfc(m,s)|> 



o<s<t L 
-^^*Sfe=o + Mfe 



fc=0 

< 



We deduce that if (m*) is a sequence satisfying Equation (|49| then {M{m^,t)) 
converges in probability to uniformly on compact sets when i tends to infinity; 
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for any T < and any e > 0, 

lim P ( sup ||M(TO',i)|| > e ) = 0. 

i-s-oo \o<t<T / 

Using Equation (jSOp and the previous equation, we can prove that for any e > 
and ?7 > 0, there exist S > and A such that for all i > A, 

The conditions of 7.2 p81] are then fulfilled and the set C is relatively compact 
and its limiting points are continuous processes. □ 
We are now able to characterize {Z2, ■ ■ ■ , Zi^{t)). 

Lemma 6. We consider a sequence (m*) satisfying Equation (j49|) and such that 
{N{inn} ,t)) converges in distribution to {Z{t)). Then the process {Z(t)) verifies 
Zk{t) ^ for 2 < k < L and t > 0. 

Proof. Define the process (A^2:l(0) with the following transition rates for 2 < 
k<L: 

Uk ^ Uk + 1 ■■ Afc, 

, rikOk 
Uk^Uk-l: fJ-k— • 

1 + Ukttk 

and such that iV2:L(0) > ./V^^(O). Clearly, {N2:L{t)) is ergodic and stochastically 
dominates (A^2:l(0- Moreover, the components evolve independently. If we call 
(^2:l(^)) a fluid limit of (A^2:L(i))i we can prove, as in ^V, Prop 5.16 pl25], that it 
satisfies 

Zk{t) = (i'fe(O) + (Afe - fik)t)+, for t > and 2 < fc < L. 

Moreover, by stochastic domination, we have Zk{t) < Zk{t) for all t > and 
2 < k < L. Since (m*) satisfies Equation (|49)) . we have that Zk{0) — 0, for 
2<k<L and we conclude that Z^it) ^ for alH > and 2 < k < L. □ 
We define N = N U {+00} and we consider N^""^. We endow N^"^ with the 
metric induced from the Li-norm on R^^^ by the mapping (x2, . . . , x^) 1— > (1/ {x2 + 
1), . . . , 1/{xl + 1)). We can note that, in particular, is compact. In the same 

way as in [12], we then define a family of random measures on [0, 00) x for 
any m G N^ any T C N^"^ ^nd t > 0, 

Vmi{0,t) xT) = / l{(Ar2(||m||s),...,Ari,(||ml|s))er} ds. 
Jo 

We then consider Co{N^^'^), the set of measures 7 defined on [0, t] x N^-^ ^nd 
such that 7([0,t) x N^^^) = t for all t > 0. Under the topology induced by weak 
convergence on every compact and since is compact, £o(N^~^) is compact. 

The next lemma shows that a random measure in £o(N^~^) can be expressed as 
the sum of probability measures of N^~^ indexed by s in 

Lemma 7. We consider a sequence (to*, i G N) satisfying Equation (j49l) . The set 



{{{N{m\t)),,^rr.^),ieN} 
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is relatively compact. If {{Z{t)),i') is a limit process then there exists a process d 
such that for all t, d{t, .) is a random probability measure on N^^^ and 



ft 

jK-2 



> 0, vr c N""", i^([o,t)xr)= / z9(s,r)ds. 

Jo 

Proof. One can find a related result in a slightly different context in [M] and [12] . 

In order to prove the relative compactness of {{{N {m^ , t)) , v^^)} , we just need 
to prove that {{N{m^ ,t)),i € N} and {vrn^,i G N} are relatively compact. We have 
already proved the relative compactness of the first one in lemma [S] £o(N^~^) is 
compact then the second one is relatively compact. 

We consider a convergent sequence ((iV(m*, i)), v^i) and its limit process ((Z(i), v) 
Let (ri, J", P) be the probability space on which they are defined. We call {J-t} the 
natural filtration of ((Z(i), v). 

We then define 7 such that 

VB e J", VC e S([0, 00)) ® B{n^~^) j{B x C) = E{lBiy(C)). 

According to ^ appendix 8], 7 can be extended to a measure on T^B{[0, 00)) (g) 
B{N^~'^) and there exists i? such that for all t, "dit, .) is a random probability 
measure on N^-^ and for any B e ^(N^-^), {'d{t,B),t > 0) is { J'tj-adapted and 
for any C € J" ® B([0, 00)), 



7(CxB)=E(/ lc(s)i9(s,B)ds 

We define 



Msit) = vi[0, t]x B)^ I i9{s, B) ds. 

"'0 



{{MB{t)) is { J'tj-adapted and continuous. We consider D e Tt. We define 

lc(<^,s) — lD{^)'^[t,+oo){s) and we have 

E {lDv{[t, +00) X B)) = 7(C X B), 

= k(^1dJ^ ^{s,B)ds 

It follows that 

E(z/([i,+oo) X = E fy i?(s,B)ds|J", 

Then, (Alsit)) is a continuous {7^t}-martingale. It has finite sample paths and then 
is almost surely identically null. Almost surely, the following equation holds for all 



VBcN^-^ v{[0,t)xB)= / i9(s,B)ds 





□ 

The previous lemma gives a convenient way to express the integral of linear 
combinations of indicator functions against a limit measure of (t'm)- We will use 
this technical lemma in the next one to characterize the limit of (vm)- This is 
the most important part of the theorem and we exhibit the time scale separation 
between classes and 1 and 2, . . . , i here. 
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Proposition 6. We consider a sequence (to*, i e N) satisfying Equation (|49p and 
such that ((N (m^ , t)) , Vm^) is a converging sequence and h a continuous function 
on [0, 1]^ X N^""^. Then, we have that 

' h{No{m\ s), Ni{m\s), N2{\\m'\\s), 7Vl(||to1s)) ds 
converges in distribution to 

f J2 h{Zois),Z^is),y)n"'^^Hy)ds 

with 



Vt e R+, a{t) 



and where, the stationary distribution of the process 

(N^-HHs)) defined m 



Section\3Ji 

In particular, the function 

{xQ,xi,n2, . . . , ni) ipoixo, xi, 71202, . . . , ulol) 

is continuous on [0, 1]^ x N^^^ and 

' MNoim\ s), N,{m\ s), iV2(||TOis), . . . , NL{\\m'\\s)) ds 



converges in distribution to 



00 ("(s)) ds 







Proof. The functions which are continuous on [0,1]^ x N^^^ for the topology 
induced by the natural topology on [0, 1]^ and the topology induced by the mapping 
{x2, ■ ■ ■ ,xl) (l/(a;2 + !),■•■, l/(a^L + 1)) are the bounded functions h which 
are continuous on [0, 1]^ x for the natural topology and such that for each 

X G [0, 1]^, y t— > h{x,y) admits a unique limit h{x,oo) in all directions such that 
llyll 00 and the function x n- h{x,oo) has to be continuous on [0,1]^. We can 
remark that, for all (xq, Xi) G [0, 1]^ 'ipo{xo,Xi, n2:L&o,2:L) — ^ when ||n2:L|| — s> +00 
and the function 

{xQ,xi,n2,...,nL) ^ 'iJjo{xo,Xi,n2a2, ■ ■ ■ ,nLaL) 

is then continuous on [0, 1]^ x N^~^. 

We consider h a continuous function on [0, 1]^ x N^^^, since the space [0, 1]^ x 
N^~^ is compact. Lemma [7] implies directly that 

^* hiNo{m\s),N,{m\s),N2i\\m'\\s), ^L(||TO'i|s)) ds^ 

converges in distribution to 
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We are now able to fully characterize the random measures {'&{., t)). For any 
continuous bounded function / on N^^^ and any m £ N^^^, we define, 

M/K = ^ (/(iV2(||mp), . . . , NU\\m\\t)) - /(O)) 

- E ^'^ r(/((^2(||m||s), . . . , NlUMs)) + ek) - f{N2{\\m\\s), . . . , NlUMs))) ds 

k=2 

J2/kl^{{fmi\\m\\s),...,Ni^i\\m\\s))-e,)-fi^^^^^ 

MNoim, s),Ni{m, s), N2i\\m\\s), . . . , iVL(||m||s))) ds. 



fc=2 



As {M{m,t)) defined by equation ((5(1)) is a martingale, {Mf{m,t)) is a martin- 
gale. We consider a convergent sequence {{N{m^, t)),^^^^). We have that {Mf{m},t)) 
converges in distribution to 0. ||m'||~i(/(A;'2(||m^||<), . . . , A^L(||m*||t)) - /(O)) also 
converges to because / is bounded. As a consequence, the following term 



E / (/((A^2(||mls), . . . , iVi(llmls)) + eu) - /(A^2(||m'P), . . . , NL{\\m^\\s))) ds 

fe=2 

Mfc /7 (/((A^2(l|mls), . . . , N^iWv^s)) - e,) - /(^2(l|mls), . . . , ^L(l|mls))) 

fc=2 ^ 

MMm\s),Nilm\ s), N2{\\w}\\s), Nl{W\\s))] ds 



also converges in distribution to 0. But, by the continuous mapping theorem and 
Lemma [71 it converges in distribution to 



TE^^ E fiv + ^k)-I{y) 

•^0 fe = 2\ y(^m-'i 



+ A^fe E (/(y-^fc) -/(y))<^/c(Zo(s),Zi(s),y) p(s,?/)ds. 



Consequently, this is null almost surely for all t and we have then, for Lebesgue- 
almost every 



k = 2 \ y(ZfiK-2 



Mfc J2 ifiy-ek)-fiy))MZo{t),Z,{t),y)U{t,y)^0. 
We deduce immediately that 

f^"^*H/)(2/W,d2/)=0 



where — Zo{t)/{Zo{t) + Zi{t)) and £7"^*) is the infinitesimal generator of 



(7V^^*^(s)), defined in Section [331 This proves exactly that .) is invariant for 
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{^2-l\^))- -^y uniqueness of the invariant distribution of such a process, we have 
that 

□ 
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